Serial No. 10/820,906 
Amendment Under 37 CFR 1.116 

Amendments to the Claims 

This listing of claims will replace all prior versions, and listings, of claims in the 
application. 

Listing of Claims: 
1-31 (canceled). 

32. (currently amended) A system for use in managing human activity of interest within an 
enterprise, comprising a computer having a model for tracking one or more human objects in a 
scene related to the enterprise and configured to 

(i) access key activity data comprising human object data related at least to the human 
features, locations, movement patterns, and predetermined other human activity of an a human 
object relative to other physically and visually distinct objects in a scene related to the enterprise, 

(ii) receive sensor data that is taken in by a sensor of a predetermined scene related to the 
enterprise, 

(iii) extract solely from the sensor data changes that enables separation of 
foreground and background objects, including human objects, localization of human object 
features, and connection of human object features that should be connected, 

(iv) classify the extracted objects , including extracted human objects, in plurality of classes 
of objects of different features, shapes, movement and behavioral patterns, 

(v) determine whether m a human object is new to the human object data in the computer 
and if so initiating tracking of the new human object and if the human object exists as human 
object data in the computer updating a track of the existing human object, and update the 
computer model in accordance with the foregoing, and 

(vi) compare human object data to key activity data to determine whether to generate a key 
activity message. 

33. (currently amended) A system as defined in claim 32, wherein the computer is configured to 
make a preliminary determination from the sensor data as whether to extract from the sensor data 
one or more human objects and the state of activity for each human object with respect to the 
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state of activity of other physically distinct objects in the sensor data, irrespective of objective 
compliance. 

34. (currently amended) A system as defined in claim 33, wherein in extracting from the sensor 
data the human object and the state of activity for the human ob ject with respect to other 
physically distinct objects in the sensor data, irrespective of object compliance, the computer is 
configured to determine if the human object has been previously extracted from sensor data or is 
being initially extracted from the sensor data. 

35 (currently amended). A system as defined in claim 34, wherein the computer is configured 
such that after the computer has processed the key activity data and the extracted human object 
data and determined whether to produce output that is related to the key activity, the computer is 
configured to receive additional sensor data taken in by the sensor of the predetermined scene 
related to the enterprise, extract from the additional sensor data an a human object and the state 
of activity for the human object with respect to the state of activity for other physically distinct 
objects in the sensor data, irrespective of object compliance, and process the key activity and the 
extracted data from the additional sensor data and determine whether to produce output that is 
related to the key activity. 

39 (currently amended) A method for use in managing human activity of interest within an 
enterprise, comprising 

a. providing a computer configured to (i) access key activity data comprising data related 
to activity of an a human object relative to other physically and visually distinct objects in a 
predetermined scene related to the enterprise, (ii) receive sensor data that is taken in by a sensor 
of a scene related to the enterprise, (iii) extract solely from the sensor data m a human object and 
the state of activity for the human object with respect to the state of activity for other physically 
and visually distinct objects in the sensor data, irrespective of object compliance, including 
separation of foreground and background objects, including human objects, localization of 
human object features, and connection of human object features that should be connected, and 
(iv) process the key activity data and the extracted data and determine whether to produce output 
that is related to the key activity; 
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b. inputting inputing to the computer sensor data that is taken in by a sensor of a scene 
related to the enterprise; 

c. extracting solely from the sensor data, via the computer, an a human object and the state 
of activity for the human object with respect to the state of activity for other physically and 
visually distinct objects in the sensor data, irrespective of object compliance , including 
separation of foreground and background objects, including human objects, localization of 
human object features, and connection of human object features that should be connected ; 

d. processing the key activity data and the extracted data and determine whether to produce 
output that is related to the key activity, and 

e. storing the detected activities in a database for extraction and use in a decision support 
system. 

36 (currently amended) A method as defined in claim 35- 39, wherein a preliminary 
determination is made, via the computer, from the sensor data as to whether to extract from the 
sensor data the human object and the state of activity for the human object with respect to the 
state of activity of other physically distinct objects in the sensor data, irrespective of objective 
compliance. 

37 (currently amended) A method as defined in claim 36, wherein in extracting from the sensor 
data the human object and the state of activity for plurality of obj e cts the human object in the 
scene with respect to other physically distinct objects in the sensor data, irrespective of object 
compliance, the computer determines if the human object has been previously extracted from 
sensor data or is being initially extracted from the sensor data. 

38 (currently amended). A method as defined in claim 37, wherein after the computer has 
processed the key activity data and the extracted data and determined whether to produce output 
that is related to the key activity, the computer (i) receives additional sensor data taken in by the 
sensor of the predetermined scene related to the enterprise, (ii) extracts from the additional 
sensor data m a human object and the state of activity for the human object with respect to the 
state of activity for other physically distinct objects in the sensor data, irrespective of object 
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compliance, (iii) processes the key activity and the extracted data from the additional sensor data 
and determines whether to produce output that is related to the key activity and (iv) update the 
already stored information of the key activity of the object. 
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